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! Abstract 

A new approach for upper bounding the channel reliability function using the 
code spectrum is described. It allows to treat in a unified way both a low and a high 
^ | rate cases. In particular, the earlier known upper bounds are improved, and a new 

O, 1 derivation of the sphere-packing bound is presented. 

I. Introduction and main results 

> 

We consider a binary symmetric channel (BSC) with crossover probability < p < 1/2 
and q = 1 — p. Let F n denote the set of all 2 n binary n-tuples, and, d(x,y), x,y G F n , 
denote the Hamming distance between x and y. A subset C = {xi, . . . , Xm} Q F n , M = 
2 Rn is called a (R, n)-code of the rate R. The minimum distance of the code C is d(C) = 
mm{d(Xi, Xj) : i ^ j}. Everywhere below log z = log 2 z. 

Cardinality of a set A is denoted by \A\. The distance distribution B(C) = 
(Bo, Bi, . . . , B n ) of the code C is the (n + l)-tuple with components 

• i-^ - 

■ Bi = | C | 1 \{(xj,x k ) : d(xj,x k ) = i}\ , i = 0, l,...,n. (1) 

Let /?-2(^) = — ^ log 2 x — (1 — x) log 2 (l — x) be the binary entropy function, and y G 

[0, 1/2], be its inverse function. 

The BSC reliability function E(R,p) is denned as follows [H [21 [3] 

1 1 
E(R,p) = limsup — In 



n P e (R,n } p) ' 

where P e (R,n,p) is the minimal possible decoding error probability P e for (R,n)-code. 
After the fundamental results of the paper pQ, a further improvements of a various bounds 
for E(R,p) have been obtained in [2-8]. Generally, on the exact form of the function 
E(R,p) it is known only that [H El E! 

£(0,p) = ~ln^-, E(R,p) = E sp (R,p), R clit (p) < R < C (p) , 
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where C(p) = 1 — h 2 (p) is the BSC capacity, and the functions E sp (R,p) and -R C rit(p) are 
defined in ([6]) and dHJ below. Moreover, if p is not too small then the formula holds 



where Ri(p) is defined in ([6]). Using the method of [9] the formula ([2]) has been obtained 
in [HI Ej for p > 0.046, and then in [8] for p > 0.04468. A corollary of this paper main 
result (theorem 1) establishes the formula (121) for p > p\ « 0.0078176. Here the value p\ is 
the minimal possible for validity of (J2J) (otherwise, Ri(p) > Raitip))- 

For < R < min {R CTit (p) , Ri(p)} still only some lower and upper bounds for the 
function E(R,p) are known [1 - 8], and in this paper the most accurate of the upper 
bounds [8] is improved. 

Let us explain what constituted the difficulty in upper bounding the function E(R,p) 
in the earlier papers [5j [7J IE] . It was shown in [5] that for a (R, n)-code there exists u 
such that B^n ^ 2^ R,U} ' n 1 where the function fj,(R,u>) > is described below, and to does 
not exceed the best upper bound (linear programming) for the minimal code distance d(C) 
(that result improved the earlier known similar bound in [10]). Note that when testing 
only two codewords Xi, Xj with large d(Xi,Xj) = d for the decoding error probability P c 
we have P e ~ (Apq) d / 2 . Therefore, if each codeword x^ has approximately B^ n neighbors 
on the distance con, then it is natural to expect that P c > {Apq) UJn ' 2 B ujn for large n (and 
not very large u) , i.e. some kind of an additive lower bound for the probability of the 
union of events holds. 

The first variant of such additive bound was obtained in [5] under rather severe con- 
straints on R. Those results of [5] have been strengthened in [6j[7], using the method of [9] 
(which, in turn, goes to [11 - 13]). There were still a certain constraints on R, p. Results 
of [6l [7] were strengthened in [8] under a milder constraints on R, p. It should be noted 
that in all those papers a various variants of the second order Bonferroni inequalities were 
used. 

The aim of this paper is to prove that additive bound without constraints on R, p. For 
that purpose the earlier method of (SJ [9] (see also [11 - 13]) is significantly strengthened 
(and simplified). Moreover, Bonferroni inequalities are not used. That approach allows to 
treat in a unified way both a low and a high rate R cases. As an example, in § 2 a new 
derivation of the sphere-packing bound is presented. Proposition 4 plays an important 
role in that method. It partially answers the natural question: how many Voronoi regions 
(i.e. how many codewords cCj) determine the output y ?) The answer: for the "essential 
fraction" of all t/'s the number of such x^ does not exceed n 2 . 

The approach used in the paper is applicable to other channels as well. In particular, 
for the Gaussian channel it will be done in the next paper. 

We describe the main paper results. Introduce the function [F4] 



E(R,p) = E sp (R crit {p),p) + R crit (p) -R, 



Ri(p) < R < RcrM 



(2) 



G(a,T) = 2 



a(l - a) - r(l - t) 1 



(1 -2a) 2 



(3) 
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If is the minimal root of the Hahn polynomial Q^ an \x), then 2x"™ = G(a,T)n[l 
o(l)], n -> cx) HI formula (B.21)], US Corollary 5.22]. It is known that 



min t) —G (1/2, h^iRj) 

o<r< Q <i/2 v y v 7 2 v /y 

h2(a)-fta(r)=l-fl 



if and only if 



R<R = h 2 (T ) w 0.30524. 
where r ~ 0.054507 is the unique root of the equation 



f(r) = (1 " 2r) 



1 + 



1 



In 1^ = 



2Vni-r 

Throughout the paper we use the values and functions 

(1-(4 M )V4) 2 



r i0) 



2(1 + ^ ' 
w 1 (p) = G?(l/2,r 1 (p)) 



Ri(p)=h 2 (r 1 (p)) 



t) = G(l/2,r) = 1 -- vMl - , ^o(ro) « 0.27298. 



-Rcrit(p) = (Tcrit(p)) = 1 ~ /&2 



v/4pg 
1 + y/Apq 

(ro) 



We have 



i?i(p) < #crit(p), if and only if p > Pl « 0.0078176 
wi(pi) « 0.149762 , n(pi) « 0.1431616 , 
RcrM<Ro, P> 0.05014, 

where pi is the unique root of the equation R\(p) = -R C rit(p)- 
Remind the sphere-packing upper bound 



£7(i2,p) < E sp (R,p) = D (h 2 \l - R)\\p) , < R < C{p) 
D(x\\v 



x 1 — X 
x log — h (1 — x) log 

y 1-2/ 

1 , 1 



E sp (0,p) = -\og— = 2E(0,p). 



Introduce also the functions 



W{u, a, R,p) = ~ log — - n(R, a, u) 
2 Apq 



(4) 



(5) 



(6) 



(7) 



(9) 
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where fi(R,a,u) is defined in (fill) , and 

F 1 (R,a,p) = max W(u;, a, R,p) , r = 1 (h 2 (a) - 1 + R) < 1/2 , 

0<u)<G(a,"r) " 

F(R,p) = min Ft{R,a,p) , a (-R) = ^(1 - • 

The following theorem represents the main paper result. It strengthens a similar The- 
orem 1 from [8]. 

Theorem 1. For any < R < C(p) the upper bound holds 

E(R,p) < mm{F(R,p),E sp (R,p)}. (11) 

The best upper bound for E(R,p) is a combination of the inequality (jTTJ) with the 
"straight-line bound" [2]. In particular, using also the random coding lower bound for 
E(R,p) [II 3J we get 

Corollary 1. If Ri(p) < i? C rit(p) or, equivalently, if p > p\ ~ 0.0078176, t/ien 

prR ^ _ / 1 - !og 2 (1 + 2^) - R, Rxip) <R< R^M, n9 . 

WW I ^sp(i2,p), #crit(p)< fl<C(p). 

In the right-hand side of (fT~2l) the relation was used (see (|2J)) 

#sp (#crit,p) + #crit = S(fl ls p) + R x = 1 - log 2 (1 + 2y/pq) . 

Therefore for R > min {R CTit (p) , R\(p)} (i.e. for r > min {r crit (p), the function 

E(R,p) is now known exactly without any additional constraints. Earlier that result was 
obtained for p > 0.046 [6f [7], and then for p > 0.04468 [8]. Corollary 1 establishes that 
result to the minimal possible p. 

Note that max{i2 crit (» - Ri(p)} ~ 0.07131, and it is attained for p « 0.0922. More- 

p 

over, i? crit (p) w 0.20219, C(p) « 0.5562. We also have limiWp) = Iimfli(p) = 1. 

Corollary 2. For i? < min {i? crit (p), i?i(p)} optimal a, u> in (|T0|) are a = 1/2 , u = 
G(l/2,r) = l/2y/r(l - t), and then 

F(R,p) = W(G(l/2,r), 1/2, R,p) = 
The formula (QJ) follows from (fTTT). ([TBI and (fTBT). 

Remark 1. Generally speaking, it is not possible to replace F(R,p) in the right-hand 
side of ( fTTT) on W(G(l/2, r), 1/2, for any In particular, it may be wrong whenp is 
small, and R is large. For example, for p = 0.001, r = 0.4 we have R ~ 0.971 < C ~ 0.989, 
but W(G(l/2, t), 1/2, R,p) « -0.0122. 

In § 2 the known result on a code spectrum [5] and some analytic properties of the 
related functions are described. In § 3 a new approach, in general, is presented, and, as an 
example, a new derivation of the sphere-packing bound is presented. In § 4 this approach 
is developed using the code spectrum, and theorem 1 is proved. 
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II. Code spectrum and functions analytic properties 
To describe the known result on a code spectrum [5j introduce the function 
(jl(R, a, uj) 



+ (l-uj)h 2 



a-u/2 
1-u 



-h 2 (a) - 2(1 - uj) log(l -uj)- 2u\oge+ 

u/2 



- 2 / log 



s{u) + 2u 2 + y/s 2 (u) -4n 2 r(l - r) 



da . 



(14) 



s(n) = a(l — a) — t(1 — t) — n , 
r = h^^a) - 1 + R) < 1/2. 



The function fi(R,a,u) is a more convenient representation of the same function from 
[5]. The next result is a variant of [21 theorem 5]. In Appendix its proof is presented since 
the proof in [5] causes some questions. 

Theorem 2. For any (R,n)-code and any a E [h 2 (1 — R), 1/2] there exists the 
value uj, < uj < G(a,r) such that n^ 1 log B^n > [i{R,a,uj) + o(l) as n — > oo ; where 
t = h 2 (h 2 (a) — 1 + and C7(a, r) and /x(-R, a, cj) are defined in ([3]) and (fT4l . 

The value a = 1/2 is the best in Theorem 2 for < R < Rq, where Ro is defined in fl5]) 
P, Remark 4] . Since for a = 1/2 we have 



1 - 2t + ^(1 - 2r) 2 - 8u + 16n 2 



s(u) + 2u 2 + Js 2 (u) - 4n 2 r(l - r) 



then for the function /i(i?, 1/2, uj), uj < C7(l/2,r), with r = h 2 l (R) after integration in 
(H3D we have [8] 



Ai(i?, 1/2, uj) = -2(1 - w) log(l -uj)-1 



3 \ i 
--2r|log(l-r)--logr+ 



+ (1 - 2w) log g + (1 - 2r) log[<? + r - w)] - ^ log JL-^-g- 



(15) 



= 



1 - 2r + ^(1 - 2r) 2 - 4cj(1 - cj) 



In particular, for = G(l/2, r) we get from ffToT) 

/i (h 2 (r), 1/2, C7(l/2, r)) = h 2 (r) + h 2 {G{l/2, r)) - 1 



(16) 



The next result which is a combination of Propositions 1 and 2 from [8], describes some 
analytical properties of the functions W{ui, a, R,p), Fi(R, a,p) and F(R,p) from (l9l)- ffT0l) . 
Proposition 1. 1) For any ao(R) < a < 1/2 and uj > we have 



dfi(R, a, uj) 
da 



>0, a Q {R) = fq\l - R) . 
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2) For any 0<r<a<l/2 and < uo < G(a, r) we have 

fi'^(R,a,u) > 0. 

Moreover, W^(u>,a,R,p) > 0, and then Fi(R,a,p) = W(G(a,r),a,R,p), if and 

u)=G(a,r) 

only if 

1 -+- ^y/pq 

3) W^t/i i?o /rom (j4]) /or any p we have 

F(R,p)= min F 1 (R,a,p) = Fi(R,l/2,p), < R < R . (17) 

a (-R)<Q<l/2 

In particular, with T\{p) from ([6]) for any p we have [8j Proposition 3] 

Fi(i2,l/2,p) = W{G(l/2, r), 1/2, R,p), if and only if r < n(p) . (18) 
III. New approach and sphere-packing exponent 

In the approach used in [H [9] we evaluated the individual decoding error probabilities 
P e (xj\xi), j ^ i. Instead, it turns out possible (and easier) to evaluate the total decoding 
error probability P c = M _1 £\ ^2j^iP e {xj\xi). When doing so the following fact is very 
important: for an "essential fraction" of all outputs y the number of the closest to y 
codewords Xi does not exceed n 2 (see Lemma 3). 

To describe our approach, for an integer t and an output y define the set: 

My) = {^eC:d( y , Xi )=t} , yeY. (19) 

All codewords {xt} are assumed equiprobable. For a chosen decoding method denote 
P(e\y, Xi) the conditional decoding error probability provided that x^ was transmitted 
and y was received. Denote P e (y) the probability to get the output y and to make a 
decoding error. Then we have 

M n 

' "'a.y.Xi 



Pe(y) = —J2p(y\xi)P(e\y, Xi) = —J2 Yl P(y\ x *) p 
*=i t=o x.extiy) 

/— n \m/ t rv Mil /— n \2/ 



t=o w/ Xi&ttiy) t=o 
where [z] + = max{0, z}. For the decoding error probability P e we get 



yev t=o vy/ 2/ : |x t (y)|>2 



6 



Using the simple inequality (a — 1) > a/2, a > 2, we get 



2M 



E 

t=Q 



y:|Xt(2/)|>2 



(20) 



where X t (j/) is defined in f|T9l . To develop the right-hand side of (TSUI) denote 

Zt(i) = {y:d(i/,aji) =t, |X t (y)| > 2} = 
= {y : £Cj) = t and there exists Xj ^ Xi with d(£Cj, y) = t} . 

Then we can represent the inequality (1201) as follows 

t m 



2M 



t=o 



E(;)Ei* 



(21) 



1=1 



As a result, we get 

Proposition 2. For i/ie decoding error probability P e the lower bounds (!20~!) and 
(T2TT) /ioW. 

Remark 2. Although simple, the lower bounds (1201) and (l2~TT) - (l22l) give the exact ex- 
ponent order of the best P e for any rate R. It is so because for the optimal (maximum 
likelihood) decoding we have equalities (for exponents) in all their derivation steps. 

Example - Sphere-packing upper bound. We show first how to get the sphere- 
packing upper bound (jSj) from f|2T|) . Note that 



z)\Z 



(2), 



z! 2) W 



i) = {y: d(y,Xi) = t} , 
{y.d(y,x l )=t, \X t {y)\ = l}. 



Therefore we have 



M 



M 



Z«(l) 



M 



Y t = {y:|X t (i/)| = l} = 
= {?/ : there exists exactly one £Cj with £Cj) = t} . 

Since |Y t | < 2 n , we get from (EU) and ([22]) 

t 



(22) 



P. > 



q'- 

max 

2M 0<t<n 



M 



(23) 



To maximize the right-hand-side of (|23|) for M = 2 Rn , R > 0, it is sufficient to set 
t = x n + 5, where 

3 log(n + 1) 



R + h 2 (x ) 



6 



log((l - Xq)/xq) ' 

Then for large n we have Mm — 2 n > 2™ log(n+l), and from f[2"3"j) we get the sphere-packing 
upper bound ([8]). 
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IV. Lower bound (ED) and code spectrum 

To investigate the reliability function E(R) for R < R crit we use the simplified (but 
exponentially equivalent) form of the lower bound (pi]) 

n / \ tn M 

P c > ^— max max ( - ) V I Z; (t , u) I , (24) 
~ 2M o<t<i uj \q J K J 

where 

Zj(t, cu) = {y : there exists Xj with d(cEi, a^-) = uon and cf(£Cj, y) = d(xj, y) = tn} . 

We develop the lower bound (124"]) . relating it to the code spectrum ([I]), i.e. to the 
distribution of the pairwise distances d(x iy Xj). Note that in (]24l the sets {Zj(£, u;)} can 
be replaced by any their subsets. 

For a codewords Xi, Xj with d(xi, Xj) = dij = um introduce the set 

Z i:j (t, u) = {y : d(x { , y) = d(xj, y) = tn} . 

Then for any i we have 

Zi(t,u)= |J Z -(t,w). 

j:dij=um 

Denote 

Xj(y, t, w) = {ccj : d(cc;, cc,-) = wn, d(a;i, y) = d(aj 3 -, y) = tn} , 



^max(i, = max |Xj(y, £, w) 

*,y 



(25) 



Note that if Al, . . . , An are finite sets, and any point a G |J i A; is covered by the sets 
{A} not more than K times, then 



N 



i=l 



1=1 



Therefore we have 



\Mt,")\> y 77 \ E l Z ^)i- ( 26 ) 

y.dij=uin 

Since the cardinality | Z^- (t , a>)| does not depend on indices we denote it simply 
Z(t,u). As a result, we get from (]24l) and (126]) 

P c > ^ max max J ^(t,.) } . (27) 
" 2 o<t<i w | \qj X max (t,uj) ( 
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For the value Z(t,oj), uj/2 <t< 1/2 we have (n — > oo) 



-log 2 Z(t,oj) = -log 2 
n n 



u(t, uj) — uj + (1 — ui)h 



«L(*> W ) = 2 log 2 



(1 — uj)n \ ( un 
(t - uj/2)n) \wn/2, 

1 1 -2t 



u(t,u) + o(l) 



2 2(1 — oj 
1 - 2t) 2 



f28l 



(1-C)2j 



< 0. 



We formulate the result obtained as follows. 

Proposition 3. For the decoding error probability P c the lower bound (1271) holds, 
where X max (t, uj) and Z(t,uj) are defined in (|2"oT) and (12"%]) . respectively. 
We set below 



t(uj) 



mm 



uj 

2 + 



cu/2 + ( 
(1-VT 



-u)p, 
2uj) /2, 



1 - VI - 2cj 
2 

w > ^i(p), 
^ < ^i(p), 



(29) 



where cui(p) is defined in ([6]). Such choice of the function t{oj) has a certain optimal 
properties (see Remark 4 further). In particular, after a "cleaning" procedure [8] the value 
^max(^(w), does not exceed n 2 , and then it will not influence the exponent of P e . 

To upper bound the value X ma _ x {t(u), uj) we use the following known result. Let 
A(n,d,w) be the maximal cardinality of a constant weight w code {xi} with d(xi,xj) > 
d, i 7^ j. Due to Johnson's bound [T71 Theorem 17.2.2] and [T7J Theorem 17.2.4] we have 



A(n, d, w) < 



dn 



(2w 2 — 2wn + dn) + ' 

Tl 

A(n, d, w) < — A(n — 1, d, w — 1) . 
w 



(30) 
(31) 



Consider first 

The model case. It exhibits an important property of the function t(uj) from (1291 . 

Proposition 4. Let {x±, . . . , xa} be a code of length n with w(xi) = t{u)n and 
d(xi,Xj) > uon, i ^ j, and the function t(uj) be defined in (1291) . Then for any uj < 1/2 
and p the inequality holds 

A<n 2 . (32) 

Proof. If uj 7^ uJi{p), then with t(uj) from ( |29l) we have 2w 2 — 2wn + dn > 0, and 
hence 2w 2 — 2wn + dn > 1 (since the last value is an integer). Therefore from ( 1301) we get 
( 132]) . If uj = u>i(p), then 2w 2 — 2wn + dn = 0. Now we use first the inequality (I3TT) . and 
then to the value A{n — 1, d, w — 1) apply the upper bound (130]) . Then with w = t{uJi)n 
and d = uj\n we have 

2{w - I) 2 - 2{w - l)(n - 1) + d(n - 1) = 2n - 2w - d = 
= n[2 — 2t(u;i) — uji] = 2n(l — uj\)q . 
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Therefore from (130]) and ([51]) we get 



A(n, d, w) < —A{n - 1, d, w - 1) < 
o;i(n — 1) (n — 1) 



d(n- 1) 



2g(l - u;i)t(u;i) ^/g 



2(1 — uji)qw 
< nV2, 



from which we again get (132]) . 



▲ 



For a code {iei, . . . ,xm} consider, say, the codeword Xi and its neighbors {xi} with 
d(xi, x^ = ujn. Suppose that all those neighbors {x^ satisfy also the condition d(x iy Xj) > 
ujn, i 7^ j. Due to (I3"2l) for any y G Zn(t(uj), uj) there exist less than n 2 neighbors {x^}, 
satisfying the inequality 



i.e. in that model case we have |Xi(y, t(uj), u>)\ < n 2 for any y. 

Assume now that for the whole code {xi, . . . , Xm} we have d(Xi, Xj) > urn, i ^ j. Then 
|Xj(y, t(u>), u>)\ < n 2 for any i and y, i.e. X max (t(co>), uj) < n 2 . Therefore in such a model 
case X max (t(u>), uj) does not influence the exponent of the value P e . 

Remark 3. In essence, proposition 4 asserts that for an "essential fraction" of all y the 
number of Voronoi regions determining y, does not exceed n 2 . 

General case. In the general case for some uj we are interested in a pairs (x^, Xj) 
with dij = ujn. But there may exist a pairs (xk, x{) with du < uju. Using the "cleaning" 
procedure [8] we show that the influence of such pairs (a^, xi) on the value P e is not large. 
It will allow us to reduce the general case to the model case, 

Remind that MB vn is the total number of pairs (xi, Xj) with d^ = vn , and Z(t(v), v ) 
for such pair (xi, Xj) is the number of points y such that 



and assume that it attains its maximum for some for v — s < G(a, r) (if there are several 
such s, we choose the smallest one). We show that for large n the inequality holds 



d(cci, y) = d(xi, y) = t{uj)n , 



d(xi,y) = d(xj,y) = t(v)n. 



Consider the function 




v < G(a, r), 



(33) 




(34) 



Then from (|34j) and (TTOT) the upper bound ( TTTT) and theorem 1 will follow. 
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To make the cleaning procedure we estimate the value B Xn Z(t(s), A), A < s. By defini- 
tion of the value s for any A^swe have 

B Xn <i P -Y S)n ' t(X)n B, Zm ' S) 



qj Sn Z(t(X),X)- 

Multiplying both sides of that formula by Z(t(s), A), due to (128]) we get that it is equivalent 
to the inequality 

1 B Xn Z(t(s),X) ^ 

- log , , , , < g(X, s) , 

n B sn Z(t{s),s) 

g{X, s) = u(t(s), A) - w(t(A), A) - [t{s) - t(X)} log ^ = (35) 



(1-A) 



fl l-2t(s) \ fl l-2t(A) \ 
U~ 2(T^AyJ U" 2(1 -A) ) 



2(1- a) ;j 



Depending on a; the function t(co>) has one of two forms (see the formula fl29|) ). Therefore 
there are possible three location cases of the values A < s and LO\{p): 1) A < s < u>i(p), 2) 
U\{p) < X < s, and 3) A < cu^p) < s. We consider them separately. 

1) Case X < s < uj\{p). Essentially, it corresponds to the case R > R\(p)- Since 
R\{p) < -R cr it(p), if p > Pi ~ 0.0078176, we may assume that p > p 1 . It is sufficient to 
consider the case R = Ri(p), and after that for R±(p) < R < R C rit(p) to use the "straight- 
line bound". For that purpose we prove the following result. 

Proposition 5. If p > p\ ~ 0.0078176 (see ([7])), then 



E(Ri{p),p) < min max { ^ log — n(R u a, u) \ = F{R x {p),p) 

a uj<G(a,n) [ 2 Apq J 

= y log ^ - KRi, 1/2, wi) = 1 - log 2 (1 + 2^p~q) - R x [p) , 



(36) 



where u x = (2(1/2, n(p)), #1 = h 2 {r 1 (p)). 

Proof. Note that for p > 0.04468 validity of the relation (|36|) was proved in [H 
corollary 2]. Let c? m ; n = c<Vi n n be the minimal code distance. Then we should have 

Umm log > — log niRi, 1/2, LOi) , 

2 4pg 2 4pg 

(otherwise the desired bound f[3"6"j) is valid), or, equivalently, 

2^(^,1/2,^) 



log(l/(4pg)) 
where the formula ffT6l) was used. 



[1 - log 2 (1 + 2y/pq) - h 2 (r 1 (p))} = u n 



(37) 
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For the function g(X,s) from (1351) we have 



0(A, *) = (!- A) 



-- 



1 VI - 2s 



= h 2 
1 

_ 2V1 - 2A 
1 

+ 



2 2(1 -s 
VI - 2s - Vl - 2A 
1 VI -2A 



ho. - 



1 V1-2A 



1 

+ 2 



2 2(1 - A) 
V 



+ 



2 2(1 - A) 

i ? A 
log 



1 VI - 2s 

2 ~ 2(1 - s) 



+ 



log 



1 - A + VI - 2A 
/> (1 - A) "° 1-A- VT^2A. 

- h 2 {p) + 



(3* 



> 



log 



/l9 



9 



1 VI - 2A 

2 ~ 2(1 - A) 



A , 1 - A + V1-2A 
log 



2V1 - 2A L P (1 - A) 1-A - VI - 2A. 
Due to (157)) we may assume that 

oj m < X < s < uj\ . 

Combining analytical and numerical methods we can check that 

min #" 2 (A,s) > B(p) > 0, p> 0.003, 

0(w m ,a;i) < -0.0008, j9<0.22, 
max {u)i(p) — u) m {p)} ~ 0.1076 , 



(39) 



where the function B(p) monotone decreases with p, and, for example, 5(0.003) ~ 0.009. 
Since g(s, s) = 0, we get from ([35]) and (j3g) - (j35]l for 0.003 < p < 0.22 and u m < A < s < oj x 



- lo s l^irH < s ) < "( s - ^ D > D ~ °- 013 

n B sn Z[t{s),s) 
Using (T4"0l we get for any 5 > and cj to < s < co>i 

y B Xn Z(t(s) |, A) 2 -n(*-A)D ^ni. 

^ 5 sn Z(t(s),s) ^ 



(40) 



w m <A<s— 5 



o; m <A<5— <5 



We set 



and then get 



6 = Si 



2 logn 



^ B Xn Z(t(s), A) < n- 1 B an Z(t(s), s) 

<A<s-5i 



Wffl < s < UJl {p) . 



(41) 
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Now we perform a cleaning procedure. Consider a pair (xi, Xj) with d%j = sn. We 
say that such pair (t,s) -covers a point y if d(xi,y) = d(xj,y) = tn. Then MB un pairs 
(asj, Xj) with djj = (t(s), s)-cover MB sn Z(t(s), s) points ?/ (counting also the covering 
multiplicities). We disregard all points y that are (t(s), A)-covered for A < s — Si. Then 
we remain with points y that can be only (t(s), v )-covered with v > s — 5\. Introduce the 
set 

Z'f r\ _ f V is (t(s), s)-covered and is not 1 , 
1 (i(s), A)-covered for any A < s — 6 J ' 



Then we have 



Z'(s,5i) C UZi(t(s),s). (43) 



Due to the relation (!4"Ij) all points of the set Z'(s,Si) in total are (t(s), s)-covered, at 
least, M(l — l/n)B sn Z(t(s), s) times. For any e Z'(s, 5i) and any covering pair (x^, Xj) 
we have d{j > (s — 5i)n. Due to the formula (|32jl the covering multiplicity of any point 
y G Z'(s, 5i) does not exceed n 2 . Therefore for s < U\(p) we get from fT43|) 



IZ'^^OI > n- 2 M(l - l/n)S w Z(t(s),s). (44) 
Now from fj44l) and ff24l) we get for s < uj\{p) 

P c >^Mg)' W "B,„Z( tW , S ). (45) 

Due to the Theorem 2 there exists uo < G(a,r) such that B wn > 2^ R > a ^ n +°( n \ Then by 
definition of the value s from (|33|) and (|45|) we get 

P c > \ J ' - B„ n Z(t(uj),uj) , 0.003 < p < 0.22 . 



2n 2 \q 

From the last relation the bound fl36|) for 0.003 < p < 0.22 follows. But that bound is 
interesting only for p > p\ w 0.0078176 (for p < pi the sphere-packing bound is more 
accurate) . 

If p > 0.22 then we should perform a cleaning procedure more accurately. We disregard 
the point y if it is (t(s), A)-covered by some pair (x^ Xj) with dij = An, where A < s — S±. 
Moreover, we shall demand that there exists Xk with d^ = djk = sn and the point y is 
also (t(s), s)-covered by both pairs (x{, x^) and (xj,Xk)- Then we shall essentially follow 
the computations of [8], introducing the function m(u, A), etc. We omit such repeating of 
the part of the paper [S], moreover, for such p such result was proved in [S]. ▲ 

2) Case U\{p) < A < s. Taking into account a different form of the function t(s) from 
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fl29|) . we have 



g(X,s) = (l-X) 
, 1 



ho - 



1 (l-2p)(l-s) 



<l\ = - log 1 lo£ 



2(1 - A) J hip) 
(1 - 2p) 2 (l - s 
(1-A) 2 



n 

9 xx 



(l-2p) 2 (l-s) 2 log 2 e 



(l-A)[(l-A) 2 -(l-2p) 2 (l- S ) 2 ] 
Since (/(a, s) = g' x (s, s) = 0, we have 



~ - p) (s - A) log ^ 

> , A < s , 



s(A,*)<-^-^( S -A) 2 , 

and then for u>i(p) < A < s we get 

1 5 An Z(t(s),A) ^ (l-2p) 2 



a;i(p) < A < s , 



— log ■ 

n B sn Z(t(s),s) 



< 



6 



(s-A) 2 , \<s. 



Now for 5 > we have 



E BxnZjt(s), A) 2-( 1 - 2 p) 2 (*- A ) 2n / 6 < n 2- ( - 1 - 2 P) 2s2n / 6 

B sn Z(t(s),s) ^ 



wi (p)<A<s— 5 



£Ji (p)<A<s— 5 



We set 



5 = 5 2 



\JY2 logn 



(l-2p)V^ 
and then get 

B Xn Z(t(s), A) < n- 1 B sn Z{t{s),s) . 

tt>i(p)<A<s-<5 2 

Similar to the previous case, we disregard all points y which are (t(s), A)-covered for 
A < s — <5 2 . Then we get the set Z'(s, £ 2 ) from (|4"2]) . for which the relation (143]) holds. All 
points y of the set Z'(s, <5 2 ) in total are (t(s), s)-covered, at least, M(l — l/n)B sn Z(t(s), s) 
times. For any such covering pair (a^, Xj) we have dy > (s — 5 2 )^- Due to Johnson's bound 
(I30p the covering multiplicity of any point y does not exceed n 2 , if 



s > CJi(p) + 



5 2 



(46) 



\/4pg + 5 2 (1 - 4pg) + y/Apq 
Therefore for s, satisfying the condition (T46"]) . we get from (T431 

|Z'(s,«J 2 )| > ^ 2 M(1 - l/n)5 sn Z(t( S ),s). (47) 
Now from fT44l and fl24l we again get (|4"5l) . from which the upper bound fl34l) follows. 
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3) Case A < 0J\{p) < s. For the function g(\, s) from (1351) we use the representation 



g(\ s) = /(A, s) + g(X, Wi(p)) 
/(A, s) = u(t(s), A) - A) - [t(s) 



*(^l)] lo S- 
P 



and get 



/(A, a) 



A) 



ho. - 



[l-s)(l-2p) 

2(1 -A) J \2 
(s-LJ 1 )(l-2p) q 
2 % 



;i-^)(i-2 P ) 

2(1 -A) 



_ (1 ~ 2p) 
2 

/«(A,a) = 



l-A+(l-s)(l-2p) g 

lOS — log — 

g l-A-(l-s)(l-2p) % 



(1 - 2p) 2 (l - A) 



<0, 
< "(1 - 2p) 2 



A < u . 



(l-A) 2 -(l-s) 2 (l-2p) 2 
Therefore from Taylor's formula we have 

f(X,s)<-(l-2pf(s-u; 1 f, 
and then, using also (jlDjl . we get for 0.003 < p < 0.22 

g(\ s) < — (1 - 2p) 2 (s - cji) 2 - (c^i - A).D , cu m < A < oji < s . 



(48) 



Now we repeat the same arguments as in the case u m < A < s < uj\, but using the inequality 
(l4"8"j) instead of (HOI) . As a result, we again get the upper bound (13~4I) . It completes the proof 
of Theorem 1 for 0.003 < p < 0.22. For p > 0.22 that result was proved in [8]. A 
Remark 4. We explain the choice of the function t(u) from fl29|) . Note that when 
testing only two codewords (cEj, cc,,) with large = um for the decoding error probability 
P e we have P c ~ (4pg) wn//2 . Minimal ambiguity set (i.e. all outputs y for which 
aij, CKj are approximately equal) of the same probability has the cardinality of the order 
2 um/2+(i-")h(j>)n_ If u > ^(p) e ^ < ^(p)), then the function t(cu) from ([29]) gives 
exactly such order. In the case u < 0J\{p) (which corresponds to R > min{i?i(p), -R C rit(p)}) 
the function t(u>) in fl29|) is chosen such that in the right-hand side of (!30|) to have 2w 2 — 
2wn + dn > 0. 

The author thanks L.A.Bassalygo for useful discussions and constructive critical re- 
marks. 

APPENDIX 

Proof of Theorem 2. For a set A C F n and an integer w denote 

A {w) = {x e A : = w}. 
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For some w < n/2 consider a code = C(n,w) of length n and constant weight w. 
Denote by B± its spectrum values defined in ([1]). Using Hahn polynomials Qj(i) = 
Qj W \i) define the polynomials 

w 

f{x) = Y,hQAx)i (A.i) 

3=0 

where f > and /j > 0, i = 1, . . . , w. Then for the code the inequality holds 

\C {w) \f(0)+ f(d(x,y))>\C^\ 2 f , (A.2) 

x+y 

which follows from [TH formula (1.7) and §6.4]. It follows from (A.2) that 
Lemma 1. For f(x) from (A.I) introduce the set 

I = I(f , A, . . . , f w ) = {i e {1, ...,w} : f(i) > 0} . (A.3) 

If d (C^) > and \I\ > then there exists i & I such that 

4-' a MC< 2;. m • (a.4) 



Remark 5. In [51 Lemma 3] the lower bound (A.4) is derived from Delsarte (19] inequal- 
ities 

w 

^^r } QiW>o, o<j<w. 

Next result is a part of derivation of Bassalygo-Elias Lemma (cf. [51 Lemma 2]). 
Lemma 2. For any w < n and any 2i < min{n, 2(n — w) the relation holds 

B 2l (C)\C\ ff) (l - ^ = £ B 2i ((C + *)<«>) |(C + *)<">! . (A.5) 
\ / \ / xeF n 

Next result follows from (A.5) and (A.4), and in such form appeared first in [5j Lemma 

4]- 

Lemma 3. If for f(x) from (A.I) and 1(f) from (A.3) we have \I{f)\ > 0, then for 
any w < n there exists i G /(/) such that 



, 2i\ ( n — 2i\ ... . / n 
B 2i (C)[ . . / f > 



/ 2-( n )|C|-/(0) 

U7 



(A.6) 
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Proof. From the formula (A. 5) and using (A. 4) for some i G / we have 



B 2i {C) 



2i\ [ n — 2i 



w — i 



B 2i ((C + x)W) \(C + x)W\ > 



xeF r - 

* e E [fo\{c + x)M\*-f(p)\{c + xW 



> 



> 



fo 



\F»\\C\ 



£l(* 



.xeF n 



E K c + a; ) 



(«)| 



xeF n 



f 2~ 



n 



w 



\c\-f(o) 



where at the end we used the Cauchy-Bounjakowsky-Schwarz inequality, and the formula 
Ea^|(£ + *) H | = G)I4 A 

Denote xf the minimal root of the polynomial Q[ n ' w \x). Then xf +1 < xf . We use in 
(A. 6) the same polynomial f(x) as in [TU formulas (4.4) and (4.6)]: 



/(*) 



[a — x) 



■Q 2 t {a) [Qt{x) + Q t+1 {x)f 



(A.7) 



where the value t <w will be chosen later, and the parameter a e (x^ 1 ,xj u ) is such that 
Qt{a) = —Qt+i(a). Then f(a) = and f(x) < 0, a < x < w. Expansion coefficients of 
f(x) in the polynomials {Qj} basis are nonnegative (see [H]). We also have (see [14"] ) 



/o 



77 



(n - 2*)(n - 2t - 1) 



t-lj J (t + l)(w - t)(n - w - t) 

2 Q 2 t (a). 



Q 2 t (a) 



/(°) = - V V / , 
a V \ £ + 1 



t- 1 



(A.J 



We choose £ such that 



Then 



fo 



< 2-( n+1 ) 



/ 2- n Q \C\ - /(0) > / 2-(" +1 ) Q |C| 



and from (A. 6) we get 

B 2i (C) 



2i\ (n — 2i 



w — i 



fW(f)\>fo2- {n+1) \C\ 



The set /(/) from (A. 3) has the form 

/ = 1(f) = {i 6 {0, 1, ...,w} : f(t) > 0} = {0, 1, . . . , a - 1} . 
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Then the bound (A. 6) takes the form 

f o-(n+l) \r\ (n\ 2 

B 2i (C) > J0 -. ' . W , (A.9) 

and it remains us to evaluate the value f(i). From (A. 7) and (A. 8) we have 
f Q fn\ (n - 2t + l){n - 2t){n - 2t - l)(a-i) 



/(*) W (n - t + + l)(w - t){n -w-t) [Q t {i) + Qt+x{i)\ 

We consider the asymptotic case when w = an, i = £n, t = rn, where r < « < 1/2 
n — > oo. It is known [18] that 

Kn = G(a } T) m a(l - a) - t(1 - t) 
n 2 + ° {) l + 2v /r(l-r) lJ ' 

Denote 

g(a,r,0 = lim -logQjr^n) . (A.10) 

Then 

lim - log -j^r = h 2 (r) - 2q(a, r, f ) , 

n->oo n J [l) 

and from (A.9) we get (since h 2 (a) — h 2 {j) = 1 — i?) 

lim -logB 2$n (C) > 

n— >oo 77, 

> i2 + 2/12(0;) + fc 2 (r) - 1 - 2£ - (1 - 2£)h 2 (j^j ~ 2<z(a, r, = (All) 
= /i 2 («) + 2/i 2 (r) - 2£ - (1 - 2O/12 (f^) " 2 <?K r ' 0- 

Therefore it remains us to evaluate the function q(a, r, £), moreover it is sufficient to upper 
bound it (as accurate as possible). How to do that, essentially, is described in [TJ]. Denote 



q (a, r, = /i 2 (r) - ah 2 ( 1 ) - (1 - a)h 2 ( j^—) - 2£ log ? - £+ 

a / \ 1 — o; / e 



" / l0£ 



s(u) + 2m 2 + y/s 2 (u) -4r(l - r) 



it 2 



(A.12) 







s(it) = a(l — at) — r(l — r) — u . 
Lemma 4. 27ie estimate holds 



,,an 



q(a, r, < gb(a, r, , £ < ^ ^L^L= ^ = ^ + o(l) , (A.13) 

1 + 2y r(l — r J w 
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where q(a,T,£) and qo(ai,T,£) are defined in (A. 10) and (A. 12). 

Remark 6. In [5j formula (42)] the result similar to (A. 13) is claimed (moreover, even 
with the equality q(a, r, £) = qo(a,r, £)), but its proof is not sufficiently argumented (cf., 
for example, the derivation in [HJ formula (B.21)] of a simpler upper bound for x™)- 

Proof. For fixed n, w,j denote by X\ < X2 < ■ ■ ■ < Xj the roots of the polynomial 
Q < f' w \x). Denote also 



Then 



Pi 



i-i 



log Qj(i) = logQi(O) + ^logp fc 



g,(o) 



fc=0 



(n - 2j + 1) fn 
(n-j' + l) U 



From [T31 formula (i)] for k < X\ we have 



jlog 



< log 



Pk 



(xi — k) 2 J ~ Pfc-i 
In particular, after simple estimates we get 

Pk-i „ ej 



1 - 



(xi - fc)" 



< 



1 < 



< 1 



\2 ' 



if (xi - kf > j + 2 . 



Pk (xi — ky 

For {p k } the recurrent equation holds [21 formula (B.20)] 

(it; - k)(n - w - k)p k p k _ x - b k p k _ x + k 2 = , 

where 

6/t = w{n — w) — k{n — 2k) — j(n + 1 — j) . 
Using representation p k _i = (1 + e k )p k , where e k is evaluated in (A. 14), we have 

(w - k){n - w - k)(l + e k )p 2 k - b k (l + e k )p k + k 2 = , 

from which we get (since \/a + b < y/a + Vb) 

& fe + ^b\ - 4fc 2 (w - fc)(n - w - fc)/(l + e fe ) ^ 

Pfe S : — < 



(A.14) 



< 



2(w — k) (n — w — k) 
b k + ^Jb\ - Ak 2 (w -k)(n-w-k) 



k^Jei 



where 



2(w - k) (n - w - k) a/(w - k)(n - w - k) ' 

b\ - Ak 2 (w - k)(n - w - k) < 



< [w(n — w) — j(n — j) — kn] 2 — Ak 2 j{n — j) + 2nkj . 

Remark 7. The upper bound for p k , perhaps, asymptotically (as n — > oo) is exact, but 
it needs a more accurate investigation. 
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Denote 



fk = \/[w{n -w)-j(n- j) - kn} 2 - Ak 2 j(n - j) > , 
w{n — w) — j(n — j) 



k < 



n 



and 



Then we have 



9k 



Pk < 9k 



w(n — w) — j(n — j) — k(n — 2k) + f k 



2(w — k)(n — w — k) 



\j2nkj 



+ 



k^/Ik 



and therefore 



2(w — k)(n — w — k) ^/{w - k)(n - w - k) ' 
logpfe < \ogg k + 5 k , 



Now 



_ v / 2nkj + 2k^Je k w(n - w) ^ ^ 
k w(n — w) — k{n — 2k) — j{n — j) ^ 

= V" lo w ( n ~ w ) ~ j( n ~ j) - k ( n - 2k ) + fk _ i 
^ ' (w — k)(n — w — k) 



k=0 k=0 



We also have 



i-l ' 

log(u> — k) > / log(ty — x) dx 

h. — n <* 



k=0 

= w log w — (u> — i) \og{w — i) — % log e = u>/i2 ( — ) + % log - , 

\w J e 

where the formula was used 

bh 2 (j^j = b log b — a log a — {b — a) log(6 — a) . 

Then 



i-l 



E lo s 

fe=0 



(w — k)(n — w — k) 



w 



< -wh 2 ( — I — (n — w)/i 2 



- 2« log - . 

n — w I e 



The function T(x) = w(n — w) —j(n — j) —x(n — 2x) + f x is piecewise monotone, and it has 
not more than four intervals of monotonicity. Moreover, maxT(x) = 2[w{n — w) —j(n—j)]. 

X 

Therefore 



i-l 1 

5>gT(fc)- / logT(x)dx 
k=o { 



< 41og[u>(n — w) — j(n — j)] + 4 . 
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Hence 

i-l 



log Qk < / logTfa;) dx — wh 2 ( — ) — (n — w)h 2 ( ) — 2i log i+ 

J W \n-wj e 

+41og[w(n — w) — j{n — j)] + 4 . 
In particualr, with w = an, i = £n, t = rn we have 

if, ^ , t x , Slogn 
- ]> log fi-fc < qo{a, r, f ) H . 

fc=0 



It follows from (A. 14) that < ej(xi — k) 2 . Therefore we also have 

1 V"* r / V"* V 2wfc j + 1kyje k w(n - w) 

— > o fe < > ^=^= log e < 

n fc =o fc=o [^(^- w ) -J(^-J)]VJ(^-J) 

Jnftl 2 + i 2 Jew(n - w)/(xi - i) . n 5/2 
< — ; — ; ; n — , — loge < 



[w(n -w) -j(n- j)]y/n - j (iu - j)(n - w - j)(xx - i) ' 

As a result, with w = an, % = £n, j = rn we get 

- logQ£r°(en) < *>(«, r, + ? V1 ^ v t"T ■ (A. 15) 

n (a — r)(l — a — t)\X\ — £n) 

Since the function Q^n an \l;n) monotone decreases for £ < Xi/n, and the function 
go(a, t, £) is continuous and bounded on £, from (A. 15) the inequality (A. 13) follows. ▲ 
Replacing 2£ by a;, from (A. 13) and (A. 11) we get the Theorem 2 and ( 1T4"1) . ▲ 
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